Development and validation of the 4C Deterioration model for adults hospitalised with COVID-19 (preprint)

Prognostic models to predict the risk of clinical deterioration in acute COVID-19 are required to inform clinical management decisions. Among 75,016 consecutive adults across England, Scotland and Wales prospectively recruited to the ISARIC Coronavirus Clinical Characterisation Consortium (ISARIC4C) study, we developed and validated a multivariable logistic regression model for in-hospital clinical deterioration (defined as any requirement of ventilatory support or critical care, or death) using 11 routinely measured variables. We used internal-external cross-validation to show consistent measures of discrimination, calibration and clinical utility across eight geographical regions. We further validated the final model in held-out data from 8,252 individuals in London, with similarly consistent performance (C-statistic 0.77 (95% CI 0.75 to 0.78); calibration-in-the-large 0.01 (-0.04 to 0.06); calibration slope 0.96 (0.90 to 1.02)). Importantly, this model demonstrated higher net benefit than using other candidate scores to inform decision-making. Our 4C Deterioration model thus demonstrates unprecedented clinical utility and generalisability to predict clinical deterioration among adults hospitalised with COVID-19.

Risk stratification of patients admitted to hospital with covid-19 using the ISARIC WHO Clinical Characterisation Protocol: development and validation of the 4C Mortality Score (preprint)

ObjectivesTo develop and validate a pragmatic risk score to predict mortality for patients admitted to hospital with covid-19. DesignProspective observational cohort study: ISARIC WHO CCP-UK study (ISARIC Coronavirus Clinical Characterisation Consortium [4C]). Model training was performed on a cohort of patients recruited between 6 February and 20 May 2020, with validation conducted on a second cohort of patients recruited between 21 May and 29 June 2020. Setting260 hospitals across England, Scotland, and Wales. ParticipantsAdult patients ([≥]18 years) admitted to hospital with covid-19 admitted at least four weeks before final data extraction. Main outcome measuresIn-hospital mortality. ResultsThere were 34 692 patients included in the derivation dataset (mortality rate 31.7%) and 22 454 in the validation dataset (mortality 31.5%). The final 4C Mortality Score included eight variables readily available at initial hospital assessment: age, sex, number of comorbidities, respiratory rate, peripheral oxygen saturation, level of consciousness, urea, and C-reactive protein (score range 0-21 points). The 4C risk stratification score demonstrated high discrimination for mortality (derivation cohort: AUROC 0.79; 95% CI 0.78 - 0.79; validation cohort 0.78, 0.77-0.79) with excellent calibration (slope = 1.0). Patients with a score [≥]15 (n = 2310, 17.4%) had a 67% mortality (i.e., positive predictive value 67%) compared with 1.0% mortality for those with a score [≤]3 (n = 918, 7%; negative predictive value 99%). Discriminatory performance was higher than 15 pre-existing risk stratification scores (AUROC range 0.60-0.76), with scores developed in other covid-19 cohorts often performing poorly (range 0.63-0.73). ConclusionsWe have developed and validated an easy-to-use risk stratification score based on commonly available parameters at hospital presentation. This outperformed existing scores, demonstrated utility to directly inform clinical decision making, and can be used to stratify inpatients with covid-19 into different management groups. The 4C Mortality Score may help clinicians identify patients with covid-19 at high risk of dying during current and subsequent waves of the pandemic. Study registrationISRCTN66726260